Method and Apparatus for Increasing Personability of Instant Messaging with User Images

ABSTRACT

A method, apparatus, and computer instructions for handling instant messages. In response to receiving an instant message, a determination is made as to whether a picture of a sender of the instant message is associated with the instant message, wherein the picture is located in a preexisting database of pictures. The picture with the message is displayed on a display in the data processing system, if the picture is associated with the message.

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates generally to an improved data processingsystem and in particular to a method and apparatus for processing anddisplaying messages in an instant messaging system. Still moreparticularly, the present invention provides an improved method,apparatus, and computer instructions for improving personability ofinstant messages with user images.

2. Description of Related Art

Instant messaging is an online chat medium, allowing users tocommunicate with each other and collaborate in real time over a networkdata processing system. Instant messaging is commonly used over theInternet. Instant messaging applications monitor and report the statusof users that have established each other as online contacts.Additionally, instant messenger users may find additional contactsthrough various mechanisms. For example, a user may find other usersbased on a search for users with similar interests, such as school,investing, cars, and movies. The status in messages are typicallypresented to the user in a window on the user's data processing system.Instant messaging applications also are often employed by usersconducting business. By utilizing instant messaging, business users canview each other's availability and initiate a text conversation withcolleagues or customers when a desired contact becomes available.Millions of users communicate using instant messaging systems every day.With instant messaging becoming an important part of both personal andbusiness communications, functionality, and usability enhancement areimportant to the continued success of this type of communication tool.

One problem with instant messaging is that it is often impersonal.Particularly when working with someone that a user has never met, it iseasy for the user to forget that person's name. Identifying theimportance of a particular message may be difficult when a user hashundreds of contacts and may receive numerous messages during the day.As a result, if a message comes from that particular person, theimportance of the message may be unknown to the user. As a result,instant messaging is a rough substitute for the experience of meetingsomeone in person or face-to-face. Therefore, it would be advantageousto have an improved method, apparatus, and computer instructions forimproving the personability of instant messages.

SUMMARY OF THE INVENTION

The present invention provides a method, apparatus, and computerinstructions for handling instant messages. In response to receiving aninstant message, a determination is made as to whether a picture of asender of the instant message is associated with the instant message,wherein the picture is located in a preexisting database of pictures.The picture with the message is displayed on a display in the dataprocessing system, if the picture is associated with the message.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features believed characteristic of the invention are setforth in the appended claims. The invention itself, however, as well asa preferred mode of use, further objectives and advantages thereof, willbest be understood by reference to the following detailed description ofan illustrative embodiment when read in conjunction with theaccompanying drawings, wherein:

FIG. 1 depicts a pictorial representation of a network of dataprocessing systems in which the present invention may be implemented;

FIG. 2 is a block diagram of a data processing system that may beimplemented as a server in accordance with a preferred embodiment of thepresent invention;

FIG. 3 is a block diagram illustrating a data processing system in whichthe present invention may be implemented;

FIG. 4 is a block diagram illustrating components used in improvingpersonability of instant messages with user images in accordance with apreferred embodiment of the present invention;

FIG. 5 is a diagram illustrating an instant messaging client inaccordance with a preferred embodiment of the present invention;

FIG. 6 is a diagram illustrating an example of a messaging window inaccordance with a preferred embodiment of the present invention;

FIG. 7 is a flowchart of a process for generating an instant message inaccordance with a preferred embodiment of the present invention;

FIG. 8 is a flowchart of a process for receiving a message in accordancewith a preferred embodiment of the present invention;

FIG. 9 is a flowchart of a process for handling a message at an instantmessaging server process in accordance with a preferred embodiment ofthe present invention; and

FIG. 10 is a flowchart of a process for selecting images for a messagein accordance with a preferred embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

With reference now to the figures, FIG. 1 depicts a pictorialrepresentation of a network of data processing systems in which thepresent invention may be implemented. Network data processing system 100is a network of computers in which the present invention may beimplemented. Network data processing system 100 contains a network 102,which is the medium used to provide communications links between variousdevices and computers connected together within network data processingsystem 100. Network 102 may include connections, such as wire, wirelesscommunication links, or fiber optic cables.

In the depicted example, server 104 is connected to network 102 alongwith storage unit 106. In addition, clients 108, 110, and 112 areconnected to network 102. These clients 108, 110, and 112 may be, forexample, personal computers or network computers. In the depictedexample, server 104 provides data, such as boot files, operating systemimages, and applications to clients 108-112. Clients 108, 110, and 112are clients to server 104. Server 104 may act as an instant messagingserver to facilitate the exchange of messages between users at clients,such as clients 108, 110, and 112. Network data processing system 100may include additional servers, clients, and other devices not shown.

In the depicted example, network data processing system 100 is theInternet with network 102 representing a worldwide collection ofnetworks and gateways that use the Transmission ControlProtocol/Internet Protocol (TCP/IP) suite of protocols to communicatewith one another. At the heart of the Internet is a backbone ofhigh-speed data communication lines between major nodes or hostcomputers, consisting of thousands of commercial, government,educational and other computer systems that route data and messages. Ofcourse, network data processing system 100 also may be implemented as anumber of different types of networks, such as for example, an intranet,a local area network (LAN), or a wide area network (WAN). FIG. 1 isintended as an example, and not as an architectural limitation for thepresent invention.

Referring to FIG. 2, a block diagram of a data processing system thatmay be implemented as a server, such as server 104 in FIG. 1, isdepicted in accordance with a preferred embodiment of the presentinvention. Data processing system 200 may be a symmetric multiprocessor(SMP) system including a plurality of processors 202 and 204 connectedto system bus 206. Alternatively, a single processor system may beemployed. Also connected to system bus 206 is memory controller/cache208, which provides an interface to local memory 209. I/O bus bridge 210is connected to system bus 206 and provides an interface to I/O bus 212.Memory controller/cache 208 and I/O bus bridge 210 may be integrated asdepicted.

Peripheral component interconnect (PCI) bus bridge 214 connected to I/Obus 212 provides an interface to PCI local bus 216. A number of modemsmay be connected to PCI local bus 216. Typical PCI bus implementationswill support four PCI expansion slots or add-in connectors.Communications links to clients 108-112 in FIG. 1 may be providedthrough modem 218 and network adapter 220 connected to PCI local bus 216through add-in boards.

Additional PCI bus bridges 222 and 224 provide interfaces for additionalPCI local buses 226 and 228, from which additional modems or networkadapters may be supported. In this manner, data processing system 200allows connections to multiple network computers. A memory-mappedgraphics adapter 230 and hard disk 232 may also be connected to I/O bus212 as depicted, either directly or indirectly.

Those of ordinary skill in the art will appreciate that the hardwaredepicted in FIG. 2 may vary. For example, other peripheral devices, suchas optical disk drives and the like, also may be used in addition to orin place of the hardware depicted. The depicted example is not meant toimply architectural limitations with respect to the present invention.

The data processing system depicted in FIG. 2 may be, for example, anIBM eServer pSeries system, a product of International Business MachinesCorporation in Armonk, N.Y., running the Advanced Interactive Executive(AIX) operating system or LINUX operating system.

With reference now to FIG. 3, a block diagram illustrating a dataprocessing system is depicted in which the present invention may beimplemented. Data processing system 300 is an example of a clientcomputer. Data processing system 300 employs a peripheral componentinterconnect (PCO) local bus architecture. Although the depicted exampleemploys a PCI bus, other bus architectures such as Accelerated GraphicsPort (AGP) and Industry Standard Architecture (ISA) may be used.Processor 302 and main memory 304 are connected to PCI local bus 306through PCI bridge 308. PCI bridge 308 also may include an integratedmemory controller and cache memory for processor 302. Additionalconnections to PCI local bus 306 may be made through direct componentinterconnection or through add-in boards. In the depicted example, localarea network (LAN) adapter 310, SCSI host bus adapter 312, and expansionbus interface 314 are connected to PCI local bus 306 by direct componentconnection. In contrast, audio adapter 316, graphics adapter 318, andaudio/video adapter 319 are connected to PCI local bus 306 by add-inboards inserted into expansion slots. Expansion bus interface 314provides a connection for a keyboard and mouse adapter 320, modem 322,and additional memory 324. Small computer system interface (SCSI) hostbus adapter 312 provides a connection for hard disk drive 326, tapedrive 328, and CD-ROM drive 330. Typical PCI local bus implementationswill support three or four PCI expansion slots or add-in connectors.

An operating system runs on processor 302 and is used to coordinate andprovide control of various components within data processing system 300in FIG. 3. The operating system may be a commercially availableoperating system, such as Windows XP, which is available from MicrosoftCorporation. An object oriented programming system such as Java may runin conjunction with the operating system and provide calls to theoperating system from Java programs or applications executing on dataprocessing system 300. “Java” is a trademark of Sun Microsystems, Inc.Instructions for the operating system, the object-oriented programmingsystem, and applications or programs are located on storage devices,such as hard disk drive 326, and may be loaded into main memory 304 forexecution by processor 302.

Those of ordinary skill in the art will appreciate that the hardware inFIG. 3 may vary depending on the implementation. Other internal hardwareor peripheral devices, such as flash read-only memory (ROM), equivalentnonvolatile memory, or optical disk drives and the like, may be used inaddition to or in place of the hardware depicted in FIG. 3. Also, theprocesses of the present invention may be applied to a multiprocessordata processing system.

The depicted example in FIG. 3 and above-described examples are notmeant to imply architectural limitations. For example, data processingsystem 300 also may be a notebook computer or hand held computer inaddition to taking the form of a PDA. Data processing system 300 alsomay be a kiosk or a Web appliance.

The present invention provides a method, apparatus, and computerinstructions for improving personability of instant messaging throughthe use of user images or pictures. The mechanism of the presentinvention attaches a picture of the user that is sent with an instantmessage to another user. Depending on the implementation, the picturemay be sent only with the initial message. Additional pictures are sentif the user chooses to change the picture. These pictures may be thoseof the user and may change from time to time depending on what the userselects. When a message is received by a user, the picture is displayedalong with the message by the instant messaging application. In thismanner, the user may identify the sender of the message using thepicture and associates some level of importance with the message withouthaving to actually read the message.

Turning now to FIG. 4, a block diagram illustrating components used inimproving personability of instant messages with user images inaccordance with a preferred embodiment of the present invention. In thisillustrative example, a user at instant messaging client 400 may send orexchange messages with another user at instant messaging client 402.These instant messaging clients may be executing on a data processingsystem, such as data processing system 300 in FIG. 3. The exchange ofmessages in these examples is facilitated through instant messagingserver process 404. This process allows for users to find other userswithin the instant messaging system as well as aid in the exchange ofmessages between different users.

Depending on the particular instant messaging system, instant messagingserver process 404 may only be involved in providing an indication ofwhen particular users are online and for establishing initial contactswhile users contacting users already on a buddy list may contact thoseusers directly after seeing that a particular user is online. Instantmessaging server process 404 may be located on a server, such as dataprocessing system 200 in FIG. 2.

In these examples, the different users registered to the instantmessaging system are stored in user database 406. This user databaseprovides information needed to search for and find other users as wellas contact users when they are online. Additionally, image database 408also is present within this system. This image database in theseexamples contains pictures or “mug shots” of users. In these examples,the images are typically small in size to avoid using too muchbandwidth. For example, a 1 kb image may be used in these illustrativeexamples.

When a message is sent from one user to another user, instant messagingserver process 404 may attach a picture to the message so that thepicture is displayed in the instant messaging window provided by aninstant messaging client.

In these illustrative examples, the image is sent only when the firstmessage is sent from one user to another user during a particularsession. The image may be resent at a later time if another session isestablished.

A user at instant messaging client 400 may take one or more pictures,which are stored in image file 410. These images may be sent to instantmessaging server process 404 for storage in image database 408. Imagesin image database 408 are stored in association with user or screennames, with these names acting as an index to identify images for aparticular user. Further, images received of another user may be storedin image file 410. In a similar fashion, image file 412 also containsimages for the user at instant messaging client 402 as well as forstoring messages received from another user. These image files act as acache for the pictures. Of course, other types of data structures otherthan files may be used to cache images depending on the particularimplementation.

Further, images from image database 408 may be stored within image file410 or image file 412 to provide for local caching of the pictures. As aresult, when a message is received from a particular user, the useridentification or name may be used to match up a picture in image file410 or image file 412 for display, without requiring transmission of theimage each time a session is initiated. Image database 408 may be anexisting database of images, such as a database of images used forbadges within a company or business. In this manner, an existing set ofimages may be used with the mechanism of the present invention, withoutrequiring an entire set of images to be generated for each user.

In this illustrative example, the images in the illustrative embodimentin image database 408 were originally created for a different purpose.In this case, this database of pictures was originally created as acorporate or business database for use in generating badges. Other typesof databases containing pictures of users also may be used with themechanism of the present invention. These images still may be used forthe purpose of generating badges in these examples.

In another example, BluePages is an IBM database of phone numbers e-mailaddresses, and names. A persona database with images is linked toBluePages. This database is currently accessed through the Internetusing a browser to provide employees information about other employees.Such a database may be used as image database 408. In this manner, anexisting database of pictures created for a different purpose may beused in the messaging system of the present invention. If an existingdatabase is not available, image database 408 may take the form of a newdatabase created specifically for use with the mechanism of the presentinvention.

Further, multiple images may be generated in which different images maybe sent to database 408 or transmitted to another user depending on theselection made by the user. One picture may be, for example, a happypicture, another may be a serious picture, while another picture may bea perplexed picture. With these types of pictures, based on “smileys”found in the text, different images may be transferred to the recipient.Smileys are also referred to as “emoticons”. These are expressions of anemotion typed into a message using standard keyboard characters.Illustrative examples may be viewed sideways as follows: :-)representing a smile,:-(representing a frown, and ;-) representing awink. Thus, depending on the particular picture associated with a smileyor emoticon, a selected picture may be sent to the recipient of amessage in the instant messaging system.

Turning next to FIG. 5, a diagram illustrating an instant messagingclient is depicted in accordance with a preferred embodiment of thepresent invention. The components illustrated in FIG. 5 may be found inan instant messaging client, such as instant messaging client 400 or 402in FIG. 4. These components may be implemented in a data processingsystem, such as data processing system 300 in FIG. 3.

In the illustrative example, instant messaging application 500 processesmessages, such as message 502, received from users located on remotedata processing systems. As messages are received, these messages arepresented in dialog windows 504. Additionally, dialog windows 504provide an interface for a user to input text to send messages to otherusers.

Contact and control window 506 is presented by instant messagingapplication 500 to provide the user with a list of user names, as wellas other information. Additionally, a small picture or thumbnail of eachperson on the contact list may be displayed in association with thepersons on the list. This other information may include, for example,identifying other users that are currently online. Contact and controlwindow 506 also provides an interface to allow a user to set differentpreferences. For example, the user may set passwords required to accessdifferent names used in instant messaging sessions.

Also, a user may employ contact and control window 506 to set otherpreferences, such as colors and fonts used in instant messagingapplication 500. These preferences also may include whether a picture isto be sent when a session is initiated with another user. Depending onthe implementation, the preference may be set to allow a user whoreceives messages to retrieve images of the senders from a remotedatabase or a local cache.

Further, a list of names presented by contact and control window 506 arestored in contact list 508 in these examples. Additional user or screennames may be added to or deleted from contact list 508. This contactlist is employed in presenting the list of names within contact andcontrol window 506. Further, image file 510 is accessed by instantmessaging application 500 in sending or receiving pictures that aredisplayed in association with messages in these examples.

A user may select a graphical control to set a preference to send anddisplay pictures when instant messaging sessions occur. These picturesare used to provide the user with additional personability when instantmessages are exchanged.

With reference now to FIG. 6, a diagram illustrating an example of amessaging window is depicted in accordance with a preferred embodimentof the present invention. In these examples, messaging window 600 is anexample of a messaging window within dialog windows 504 in FIG. 5.Messaging window 600 is displayed when a message is received fromanother user.

In this example, messaging window 600 includes chat history section 602and message input section 604. Chat history section 602 is used todisplay messages exchanged with a remote user. Message input section 604allows a user to input text for sending a message to a remote user.

Picture 606 is a display of a picture of a person for a current chatsession. With the use of picture 606, the user may identify or relatesome amount of importance with the message received from that remoteperson, without having to read the message. This type of personabilityfeature is especially useful in providing additional information forusers that remember faces better than names. Further, a user may beacross the room or far enough away from the display when a messagearrives such that the user is unable to read the message. With the imagefrom the sender, the user may be able to decide the importance of themessage without actually having to read the message.

Window 600 is presented for purposes of illustration and not meant as alimitation as to how pictures or images may be displayed in associationwith messages. For example, picture 606 may be displayed in a separatewindow from window 600 depending on the particular implementation.

Turning next to FIG. 7, a flowchart of a process for generating aninstant message is depicted in accordance with a preferred embodiment ofthe present invention. The process illustrated in FIG. 7 may beimplemented in an instant messaging application, such as instantmessaging application 500 in FIG. 5. This particular process istypically used when a message is first sent to a person from the user.

The process begins by receiving user input for the message (step 700).Next, a determination is made as to whether the message is complete(step 702). If the message is not complete, the process returns to step700. Otherwise, a determination is made as to whether an image is to besent (step 704). This determination may be made by checking a preferenceselected by the user or by determining whether an image or picture ispresent for the user. If an image is to be sent, the image is attachedto the message (step 706), and the message is then sent to the recipient(step 708) with the process terminating thereafter. Turning back to step704, if an image is not to be sent, the process proceeds directly tostep 708 without attaching an image, with the process terminatingthereafter.

Depending on the particular implementation, the image may actually beattached by the server process rather than at the client sideapplication. In this case, the message then includes an indication thatan image is to be attached to the message sent to the recipient.

Turning now to FIG. 8, a flowchart of a process for receiving a messageis depicted in accordance with a preferred embodiment of the presentinvention. The process illustrated in FIG. 8 may be implemented in aninstant message application, such as instant messaging application 500in FIG. 5.

The process begins by receiving a message (step 800). A determination ismade as to whether an image is attached to the message (step 802). If animage is attached, the image is displayed along with the message in awindow (step 804). This window is similar to window 600 in FIG. 6.

With reference again to step 802, if an image is not displayed, adetermination is made as to whether the image for the sender of themessage is located in a local cache (step 806). The local cache may be,for example, image file 410 in FIG. 4. If the image is located in alocal cache, the process proceeds to step 804 as described above. Localcaching of images may save on bandwidth usage. Otherwise, the message isdisplayed in the window without a picture (step 808) with the processterminating thereafter.

Turning next to FIG. 9, a flowchart of a process for handling a messageat an instant messaging server process is depicted in accordance with apreferred embodiment of the present invention. The process illustratedin FIG. 9 may be implemented in an instant messaging server process,such as instant messaging server process 404 in FIG. 4.

The process begins by receiving a request for a contact (step 900). Thisrequest may be to initiate a session with a person listed as a contactfor an instant messaging client. A determination is made as to whetheran image of the sender is present in an image database (step 902). Thisimage database may be, for example, image database 408 in FIG. 4. If animage of the sender is present, the image is attached to the message(step 904).

Thereafter, the message is sent to the recipient (step 906) with theprocess terminating thereafter. With reference again to step 902, if animage is not present, the process proceeds to step 906 to send themessage to the recipient without attaching an image. The process thenterminates.

With reference now to FIG. 10, a flowchart of a process for selectingimages for a message is depicted in accordance with a preferredembodiment of the present invention. The process illustrated in FIG. 10may be implemented in an instant messaging application, such as instantmessaging application 500 in FIG. 5. This process may be implemented toselect an image from a group of images to be sent with a messagingprogram. In these examples, the image is selected based on a smiley oremoticon that may be present in the text.

The process begins by determining whether a smiley is present in thetext (step 1000). If a smiley is present, a picture is selected based onthe smiley (step 1002) with the process terminating thereafter. If asmiley is not present in step 1000, the process selects a defaultpicture (step 1004) with the process terminating thereafter. In thismanner, the message displayed in the window may change depending on theparticular smiley or emoticon used by a user. Additionally, theparticular picture selected also may be changed based on other types ofindicators other than smileys depending on the particularimplementation.

Thus, the present invention provides an improved method, apparatus, andcomputer instructions for improving personability of instant messagesthrough the use of user images. In these examples, pictures aredisplayed with instant messages so that a user receiving an instantmessage from another person can have a visual identification of thatperson in addition to merely a name on a contact list. In this manner,an advantage is provided for people who remember faces better thannames. Further, the importance of a message also may be identifiedwithout reading the message when a picture is presented with themessage. These pictures may be obtained in different ways, such as, forexample, from the sender with the message, from a locale cache, or froma database on a remote server.

Additionally, other features may be implemented with this particularinstant messaging system. For example, other features, such as blockingpictures, may be employed. With this feature, a user may block thetransfer of the user's image to another recipient.

It is important to note that while the present invention has beendescribed in the context of a fully functioning data processing system,those of ordinary skill in the art will appreciate that the processes ofthe present invention are capable of being distributed in the form of acomputer readable medium of instructions and a variety of forms and thatthe present invention applies equally regardless of the particular typeof signal bearing media actually used to carry out the distribution.Examples of computer readable media include recordable-type media, suchas a floppy disk, a hard disk drive, a RAM, CD-ROMs, DVD-ROMs, andtransmission-type media, such as digital and analog communicationslinks, wired or wireless communications links using transmission forms,such as, for example, radio frequency and light wave transmissions. Thecomputer readable media may take the form of coded formats that aredecoded for actual use in a particular data processing system.

The description of the present invention has been presented for purposesof illustration and description, and is not intended to be exhaustive orlimited to the invention in the form disclosed. Many modifications andvariations will be apparent to those of ordinary skill in the art. Theembodiment was chosen and described in order to best explain theprinciples of the invention, the practical application, and to enableothers of ordinary skill in the art to understand the invention forvarious embodiments with various modifications as are suited to theparticular use contemplated.

1-4. (canceled)
 5. A method in a data processing system for handlinginstant messages, the method comprising: responsive to receiving aninstant message, determining whether a picture image of a sender of theinstant message is associated with the instant message; and displayingthe picture image of the sender with the instant message on a display inthe data processing system if the picture image of the sender isassociated with the instant message, wherein the picture image of thesender is embedded by an instant messaging process of the sender intothe instant message prior to sending the instant message to the dataprocessing system, and wherein the picture image of the sender is aselected picture that is selected from a plurality of different pictureimages of the sender, the selected picture being automatically selectedby the instant messaging process of the sender based upon particularcontent in the instant message, wherein the picture image of the senderis a mug shot of the sender, wherein the instant messaging processfacilitates a two-way, interactive, real-time exchange of the instantmessages.
 6. The method of claim 5, wherein the particular content is anemoticon.
 7. The method of claim 5 further comprising: receiving thepicture image of the sender with the instant message. 8-22. (canceled)23. A data processing system for sending an instant message by aninstant messaging process executing on the data processing system, thedata processing system comprising: selection means for selecting apicture image of a sender that is to be sent with the instant message,wherein the picture image of the sender is located in a preexistingdatabase of different pictures of the sender and is automaticallyselected without user intervention by the selection means based uponparticular content in the instant message; and sending means for sendingthe picture image of the sender with the instant message, wherein thepicture image of the sender is a mug shot of the sender.
 24. The dataprocessing system of claim 23, wherein the particular content is anemoticon.